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PREFACE 


The Agriculture and Resources Inventory Surveys Through Aerospace 
Remote Sensing program, AgRISTARS, Is a program of research, development, 
evaluation and application of aerospace remote sensing for agricultural 
resources. This program is a cooperative effort of the National Aero- 
nautics and Space Administration (NASA), the U.S. Departments of 
Agriculture, Commerce, and the Interior and the U.S. Agency for Inter- 
national Development. AgRISTARS consists of eight Individual projects. 

The research reported herein Is sponsored by the Inventory Techno- 
logy Development (ITD) Project under the auspices of the Earth Resources 
Applications Division of NASA at the Johnson Space Center. Dr. Jon 
Erickson Is the NASA Manager of the ITD Project and Mr. Lewis Wade Is 
the Technical Coordinator of the reported effort. 

Research herein reported In the use of remote sensing for Inventory 
and assessment of agricultural commodities Is performed under NASA Con- 
tract NAS9-16538 by the Environm(?ntal Research Institute of Michigan's 
Infrared and Optics Division headed by Marvin R. Hoi ter. Executive Vice- 
President of ERIM, under the technical direction of Robert Horvath, 
Program Manager and Richard Cicone, Task Leader. 


PRECEDING PAGE BLANK NOT FILMED 




V 


2l*JM 


TABLE OF CONTENTS 

Section Page 

1.0 INTRODUCTION 1 

1.1 TASKS AND OBJECTIVES 1 

1 .2 REPORTING PERIOD PROGRESS 3 

2.0 CORN AND SOYBEAN CROP SIGNATURE CHARACTERIZATION . . 7 

3.0 EFFICIENT AREA ESTIMATION TECHNIQUES DEVELOPMENT . . 23 

4.0 ADVANCED SATELLITE AND SENSOR SYSTEM DEFINITION . . 37 

5.0 SUMMARY 45 

REFERENCES 47 

APPENDIX A - REPORTS AND PUBLICATIONS RELATED TO 
CONTRACT NAS9-16538 SEMI-ANNUAL 
REPORT 49 

DISTRIBUTION LIST 51 


PRECEDING PAGE BLANK NOT FILMED 


v11 


LIST OF FIGURES 


jERi 

Figure Page 

1 Features Used in Profile Analysis 9 

2 Average Corn Profiles 10 

3 Average Soyb*»an Profiles 11 

4 Effects of Planting Date on Corn Profiles 14 

5 Sample Result - Proflle/Stage Association 15 

6 Separability of Corn and Soybeans Based on 

Derived Profile Features 18 

7 Average Corn Green Reflectance/Bright Reflectance 

Trajectory 19 

8 Average Soybean Green Reflectance/Bright 

Reflectance Trajectory 20 

9 Automatic Labeling Procedure Flow 24 

10 Logic Used to Identify "Classic" Profiles 26 

11 Composite Corn and Soybean "Classic" Profiles ... 27 

12 "Non-Classic" Profiles Identified by Classifier . . 30 

13 Progression of Labeling 31 

14 Test Results of C/S-IB on 1980 Iowa Data 33 

15 Confidence Interval of C/S-IB Proportion Estimates. 35 

16 Satellite Configurations 38 

17 Registered SEASAT Data from Segment 844 40 

18 Local Tone Image 41 

19 Local Texture Image 41 

PRECEDING PAGE BLANK NOT FILMED 


lx 


LIST OF TABLES 





Tabi e page 

1 Characterization of Crop Signatures 4 

2 Efficient Area Estimation Techniques Development ... 5 

3 Satellite and Sensor System Definition 6 

A Standard Statistical Measures of Area Proportion 

Estimation Performance for n Segment Processings ... 34 


PRECEDING PAGE BLANK NOT FILMED 




x1 


INTRODUCTION 


This semi-annual report describes progress made by the Environmental 
Research Institute of Michigan (ERIM) In support of the Inventory 
Technology Development (ITD) Project of AgRISTARS during the period 1 
November 1981 to 30 April 1982. 

The major objective of ITD Is to Investigate methods for "using 
space remote sensing technology to provide objective, timely and reliable 
forecasts of foreign crop production without requiring ground obser- 
vations" [1]. ERIM's primary focus Is on research of technical Issues 
requiring attention In order for ITD to achieve Its principle objective. 

1 .1 TASKS AND OBJECTIVES 

The research effort Is organized Into three tasks: 

1) Corn and Soybean Crop Spectral /Temporal Signature 
Characterization 

2) Efficient Area Estimation Techniques Development 

3) Advanced Satellite and Sensor System Definition 

The first two tasks emphasize use of Landsat Mul tispectral Scanner, while 
Task 3 explores other alternatives. 

Task 1 alms at providing the underlying understanding of the 
spectral and temporal behavior of key crops that would enable crop 
assessment and Identification without the use of ground observations. 

The near term objectives of this task Include: 

• Determine the seasonal and regional variability In the spectral 
development patterns of corn, soybeans, and confusion crops 
(e.g., sorghum) 

• Determine the environmental and cultural factors responsible 
for that varlabll Ity 
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• Evaluate alternative Landsat features In light of their sensi- 
tivity to or robustness against these factors. 

In the long term this task would provide basic research In support of 
methods that would adapt automatic information extraction techniques to 
local or regional conditions without direct ground observation. 

Task 2 explores the potential of automatic Information extraction 
by exploiting that understanding gained In crop signature character- 
ization In an area estimation methodology. Two key objectives In this 
research are to: 

• Explore factors Influencing and methods for automatic extraction 
of crop area (with emphasis on corn and soybeans) from Landsat, 
without the use of ground based training data, that adapts to 
locally specific conditions. 

• Examine alternative techniques for estimating proportions In the 
presence of mixed pixels. 

In the long term this task would explore factors Influencing and methods 
for automatic extraction of crop area that adapt to regionally specific 
conditions. 

Task 3 is designed to examine the potential of remote sensing alter- 
natives to the Landsat Multi spectral Scanner for crop assessment and 
Inventory. The primary near term objective of this task Is to: 

• Research crop related Information extraction techniques for 
engineered al tentative sensor configurations other than Landsat 
MSS alone. Including the Thematic Mapper, Meteorological Sate- 
:iites (NOAA-6 and NOAA-7 AVHRR and NIMBUS7 CZCS) and Radar 
Systems (SEASAT-SAR) . 

In the long term this task would point at developing an objective tech- 
nique for future sensor system definition. 
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1.2 REPORTING PERIOD PROGRESS 

Substantial progress has been made toward achieving the objectives 
of the three tasks previously Identified. 

Efforts In lask 1, Crop Signature Characterization, have emphasized 
conducting statistical analyses of corn and soybean field measurement 
data collected by the Laboratory for Applications of Remote Sensing 
(LARS) for the Supporting Research Project of AgRISTARS [2]. Table 1 
Identifies key accomplishments. Section 2 provides a technical d1s> 
cusslon 0 ^ highlights of the research. 

The development and evaluation of an automatic corn and soybean 
area estimation procedure was the principle emphasis of Task 2, Efficient 
Area Estimation Techniques Development. Table 2 Identifies key accom- 
plishments, while Section 3 discusses the technical effort. 

The key achievement In Task 3, Satellite and Sensor System De- 
finition, was an analysis of the joint use of SEASAT SAR and Landsat MSS 
for agricultural inventory. This study examined the potential of a 
cellular automata Inspired approach for the extraction of information 
from the radar data, and Identifies two key features, called tone and 
texture, that were found to relate uniquely to crop cover. The key 
accomplishments during this reporting period are presented in Table 3. 
Section 4 presents a discussion of the SAR/MSS analysis. 

Appendix A lists reports and articles that relate to the efforts of 
this reporting period. 
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TABLE 1 . CHARACTERIZATION OF CROP SIGNATURES 
Progress to Date 


• Field Measurement Data Analysis 

Environmental arH cultural factors affecting corn and soybean 
spectral development patterns were analyzed 

■H- Typical corn and soybean spectral development patterns 
were formulated, corn exhibiting a greenness plateau not 
seen In soybean or grains 

Key factors analyzed Included nitrogen fertilization, 
planting date, population, varietal, row spacing and soil 
moisture effects 

++ The effect of each factor on the typical trajectory was 
statistically quantified 

+ The relationship of corn and soybean profile features to crop 
development stages was established 

Unexpectedly, corn achieved peak greenness prior to peak 
LAI, a result explainable by the canopy structure 

Soybean vegetative and reproductive stages were not cor- 
related to profile features, probably due to the Indeter- 
minate nature of the plant; unlike corn canopy, closure 
was found to be the overriding factor 

* Detailed analysis of derived profile features was undertaken 

Profile features are not dependent on date of acquisition 

+■*■ loot discrimination of corn and soybeans was achieved 
asking a peak greenness and a plateau feature 

• Landsat Data Analysis 

Initiated an analysis of alternative Landsat coordinate systems 
and green measure Indicators 

+ Digitized ground truth for 16 1980-81 sites In the Argentina 
Indicator Region was Incorporated Into the RT&E data base at 
JSC 
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TABLE 2. EFFICIENT AREA ESTIMATION TECHNIQUES DEVELOPMENT 
Progress to Date 


• Developed Automatic Corn and Soybean Classification Technique Based 
on 'Classic' Crop Features that are Adapted to Segment Specific 
Factors (e.g., acquisition history) 

+ Technology, based on hlerarichical decision logic, was configured 
Into C/S-IB on LARS 4341 and EODL A>/3000 

* Conducted developmental, shakedown and Independent testing 

++ Accurate estimates (within IIX) of corn, soybeari and 
total summer crop were achieved 

++ Estimates demonstrated low (3 to 9X std. dev.) variance, 
comparable to analyst based systems 

++ High processibll Ity achieved (greater than 60X) 

++ Principle error sources Include mixed targets and confusion 
between 'corn' and 'other' classes 

• Automated Subcomponent Is Under Development that would Minimize Errors 
Due to Boundary Pixels 

+ Technique Is based on mixture decomposition technology 

++ Only pure pixels are labeled 

++ Mixed pixels are assigned mixed lables by spectrally 
decomposing the pixels Into pure component classes and 
labeling neighboring representatives of these classes 

++ The technique is expected to be less sensitive to error 
Induced by direct labeling of the mixed target or methods 
Involving replacement, or elimination of the sample 

T Technique is being configured into C/S-IC to be Implemented 
on EODL AS/30C0 
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TABLE 3. SATELLITE AND SENSOR SYSTEM DEFINITION 
Progress t) Date 


• Currently Engineered Sensor Systems 

* Exploration of the combined use of visible ranoe sensor (MSS) 
and a microwave sensor (SEASAT-SAR) for digital crop Inventory 
was undertaken 

A cellular lu^omata approach was used to remove coherent 
speckle from i.he SAR 

44 Crop related radar features called tonr. and texture were 
f'* nd to relate to crop canopy structural features 

44 Use of canopy structural features combined with MSS could 
permit discrimination six weeks prior to what Is possible 
with Landsat alone 

4 Prepared a reference summary of available civilian spaceborne 
observation systems Including NOAA, GOES, NIMBUS, and Landsat 

4 In process of building field measurement data base for simu- 
lation analysis of TM and METSAT Including: LARS Field Measure- 

ment data, ERIH's ERIS data base and Imperial Valley data base 

• Future Satellite and Sensor System Design 

4 A simulation irethodology Is under Investigation as a mechenism 
to objectively determine key system parameters recoil red to meet 
pre-specifled crop Inventory Information requiremeits 

44 Effort Is initiated as ERIM Internal Research and Develop- 
ment and v/111 be a foundation for future ITD efforts 

44 Suits canopy reflectance model combined with jensor signal 
s‘*mulat1on capability form the basis of the approach 

44 Approach Is based on parameter sensitivity analysis 
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2.0 

CORN AND SOYBEAN CROP SIGNATURE CHARACTERIZATION 



In order to successfully Inventory or essess the condition of egri- 
ciiltural crops from space, we must have techniques which are based on a 
solid understanding of the plants themselves, of the dynamics of the 
plants' Interactions with their environment, and of the expression of 
those Interactions 1i; the spectral signal received by the sensor. The 
automated crop Identification techniques required by efficiency con- 
straints on any large scale system must take Into account both the nor- 
mal or average spectral characteristics of key target classes, and the 
likely changes In those characteristics resulting from changes In field 
conditions. If they are to provide accurate data over many years and 
bread geograpnic regions. Crop condition assessment techniques must 
account for the Interactions between spectral and deve1op«iiental events, 
and the expression of stresses or other Influencing factors on crop 
spectral patterns. It Is the goal of the activity reported here to de- 
velop that physically based understanding of what remotely sensed data 
can tell us about the Identity and vigor of targeted agricultural corn- 
modi ties . 

The Tasseled Cap Transformation of Landsat MSS spectral bands de- 
veloped by CRIM personnel |3| provides both a reduction In data volume 
and an Improvement In the physical Interpretabll 1 ty of data values. The 
resulting Greenness and Brightness variables are well correlated to the 
anxiuMV of green vegetation and the brightness of the soil or target 
albedo respectively, and thus facilitate evaluation of spectral obser- 
vations as well as understanding of the spectral expression of field 
events. ERlM's development of techniques for describing and analyzing 
the co'tinuous patterns of crop spectral development (termed "profiles") 
14. S| provides a framework within which crop spectral behavior may be 
evaluated. Since Important ^pectral or developmental events are not 
restricted to the particular times of data collectio derivation of 
profiles based on the set of available data values allows a more complete 




description and analysis of crop spectral development. Careful, 
physical 1y-sound Interpolation can greatly enhance our ability to ex- 
tract meaningful Information on 1nterm1ttc.it data. 

The research reported here was undertaken to determine: a) the 
average or normal profiles for corn and soybeans, b) the effects of 
certain changes In field conditions or cropping practices on those pro- 
files, c) the association between features of tho< profiles and crop 
de>'e1opment stages, and d) the separability of corn ana soybeans based 
on profile features. 

Included In this reporting are two areas of research largely carried 
out In FY81 : 1) review of the literature of agronomic research to 

understand the development of corn and soybean plants, and their responses 
to stress, variations In cropping practices, etc., and 2) evaluation of 
the changes In Green Reflectance profiles brought about by cultural or 
environmental factors. With the Inclusion of these results, this report 
provides a complete summary of the research results as outlined above. 

The data used In these analyses were ground-level reflectances, 
collected by and at Purdue/LARS for NASA [2]. Originally recorded as 
Landsat MSS Inband reflectances, they were converted to Tassel ed Cap 
equivalent coordinates, labeled Green Reflectance and Bright Reflectance. 
Associated with these spectral observations were data related to plant 
and canopy conditions and characteristics. A total of 147 corn plots 
and 171 soybean plots from three growing seasons were available for 
analysis . 

A profile analysis technique developed at ERIM In FY81 was used to: 

1) derive smooth, continuous curves from the Intermittent data points and 

2) extract profile features for comparison and evaluation 15]. The fea- 
tures, as Illustrated In Figure 1, relaLe to the maximum profile value 
and the time Intervals between points on the profile, 

Ave'^age Profiles . Figures 2 and 3 show the average or nonnal pro- 
files in both Green Reflectance and Bright Reflectance for corn and 
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FIGURE 3. AVERAGE SOYBEAN PROFILES 
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soybeans. These profiles are averages of those corn or soybean plots 
that were free from anomolous data values and had observations through- 
out the growing season. The Green Reflectance profiles are actual 
mathematical averages, with one standard deviation denoted with the 
dashed lines. Because of the effects of soil variability on Bright 
Reflectance profiles In the early season, mathematical averaging was not 
feasible, so average Bright Reflectance profiles were derived based on 
qualitative analysis. 


Of particular interest in the profiles illustrated is the “plateau" 
or flattened top of the corn Green Reflectance profile. This feature 
was seen in most of the corn plots, and additional evidence for Its 
existence was also found [5]. As a .'esult, a mathematical profile model 
for corn Green Reflectance which explicitly Includes the plateau was 
developed at ERIM. The model is of the form: 


G(t) 


7 7 i ^ 1 ^ 

1 + Q^(t-t P 


( 1 ) 


(A-25)*g(a^A) (cot"^[a(t-tp - a)]) ♦ 25 ; t > t^ 


where 

G(t) 

A • *Q 

A 

Q 

a 

A 


Greenness at time t 
model parameters 

maximum function value (peak Greenness) 

day of maximum function value 

inverse time from first half-peak to peak 

controlling factor for shape after peak (flatness 
of peak, steepness of decline) 

time of peak to second half-peak 


and 


12 



g(a,A) = Tt/COt ^(-a*A) 

(provides continuity at t ■ tp) 

The average Corn Greenness profile shown In Figure 2 Is based on pro- 
files obtained through application of this model. The soybean profiles 
were derived with a cubic smoothing spline. 

Cultural and Environmental Effects . The Impact of nitrogen avail- 
ability, planting date, row spacing, plant population and variety were 
assessed In terms of changes In profile features. Many of the experi- 
mental treatments had significant effects on profile features, and par- 
ticularly on the peak value of the Green Reflectance profiles. Figure 4 
Is provided as an example of the results obtained. Late planting of 
corn, which generally exposes the plants to higher ♦emperatures through 
much If not all of their development cycle, tends to result In more 
rapid emergence and growth, while the cool temperatures encountered with 
early planting tend to delay emergence and retard growth. Both situations 
tend to be more stressful than a "normal" planting date. The figures 
Illustrate the effects of planting date on profile characteristics. 

An additional important piece of Information is that many of the 
experimental treatments affect the same profile features. For example, 
the maximum Green Reflectance value may be reduced as a result of early 
or late planting, reduced nitrogen availability, wider rows, or lower 
population densities. Thus In terms of crop condition assessment. It 
appears that use of spectral data alone for determination of the pre- 
sence or absence of a specific stress or condition Is probably not 
feasible, though a general assessment of crop condition might be possible. 

Association of Spectral and Development Events . Development stage 
data, smoothed and Interpolated In a manner similar to that used for the 
spectral data, was used to determine the stages of development associated 
with key Green Reflectance profile features (Figure 5 provides an ex- 
ample of the merging of the two data types). 
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For corn, peak Green Reflectance occurred at Hanway stage 2.5 to 
3.0, well before tassel Ing or silking (the stage at which peak LAI 
usually occurs) and also before apparent maximum canopy closure. The 
lack of Increase In Green Reflectance after stage 2.5 to 3.0 Is pro- 
bably the result of changes In canopy geometry, particularly the spread- 
ing of green leaf area over a greater vertical depth, an Increase In the 
proportion of canopy components comprised of stems, perhaps an Increase 
In the vertical orientation of the leaves, and after stage 4.0, the In- 
troduction of tassels Into the top layer of the canopy. The plateau of 
corn Green Reflectance ends In response to the Increased emphasis on 
dry matter accumulation In the kernels. 

Soybeans were found to have little association between a particular 
stage of development and a particular profile feature. When no lodging 
was reported the peak Green Reflectance value tended to occur at the 
maximum vegetative stage, but where lodging was reported, the peak often 
occurred much earlier. Since many soybean varieties are Indeterminate, 
there is no "final" vegetative stage for all plants, nor Is there any 
simple association between vegetative and reproductive stages of de- 
velopment. Thus neither vegetative nor reproductive stages could be 
connected to the peak in the soybean profile. A much stronger asso- 
ciation was found between soybean peak Green Reflectance and maximum 
percent cover or Leaf Area Index. 

Separability of Corn and Soybeans . Features of corn and soybeans 
profiles were compared to determine the major sources of separability. 
Both the previously mentioned crop profile model and the more general 
spline technique, which made no assumption concerning the plateau fea- 
ture, were used for corn, the latter because It gave a better Idea of 
the results one might achieve In a more operational setting. 

The primary sources of separability In Green Reflectance were the 
peak profile value (higher for soybeans) and the rate of Green Reflec- 
tance decline after the peak (faster for soybeans). Indeed, In this 
data set these two features together provided lOOt separability (Figure 
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6) using the more general spline technique. It should be noted that the 
rate of decline difference was probably largely related to the plateau 
feature of corn. Very little early season separability was apparent, 
either In terms of rates of green-up or relative slopes of the ascend- 
ing portion of the average Green Reflectance profiles, though mid-season 
separation based on peak Greenness was possible. 

The key source of separability In Bright Reflectance was, again, 
the peak value (soybeans higher). Figures 7 and 8, composites of the 
average profiles shown In Figures 2 and 3, show that the differences In 
peak Green Reflectance and Bright Reflectance are correlated, and to- 
gether express the tendency of soybeans to move farther up the "green 
arm" thancorn. This feature Is used In current corn/soybean labeling 
techniques [6]. 

The Interaction c. 'leld conditions with the features providing 
greatest separability ^ such that one should expect, In particular cir- 
cumstances, to see degradation In discrimination results. For example, 
highly fertilized or densely-planted corn might achieve peak profile 
values similar to those of soybeans, particularly If those soybeans are 
planted early or late or In wide rows. Other such combinations can also 
be hypothesized. 

Conclusions . These studies have clearly shown that the character- 
istic patterns of corn and soybean spectral development can be signifi- 
cantly altered by fairly common variations In field conditions or 
cropping practices. Further, while the two crops can be well distin- 
guished In the profile feature space, changes In conditions can adversely 
affev.t their separability. However, using the knowledge gained here to 
develop procedures which can adapt their expectations of crop '‘pectral 
characteristics to reported local conditions should enhance our ability 
to accurately detect and distinguish between crops, even In the pre- 
sence of atypical conditions. 

For crop condition assessment, these studies show that the chances 
of detecting stress conditions using spectral data alone are not great. 
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FIGURE 6. SEPARABILITY CF CORN AND SOYBEANS BASED ON 
DERIVED PROFILE FEATURES 
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Spectral data might, however, provide a means of corroborating expec- 
tation of stress conditions determined In some other manner, since the 
effects of those conditions on profile characteristics can now be 
predicted. The observed association of corn stages of development with 
profile features, especially the Green Reflectance peak, may provide at 
least one anchor point for estimating the times of occurrence of de- 
velopment stages critical with regard to crop condition or production. 
The lack of any such association In soybeans, on the other hand, offers 
little hope for a similar anchor point with this crop. 
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3.0 

EFFICIENT AREA ESTIMATION TECHNIQUES DEVELOPMENT 

The performance of a crop inventory for a large area in a timely 
fashion requires an area estimation procedure which is efficient and 
accurate over the range of crop conditions found in the area of inter- 
est, without relying on ground-based observations. Traditionally, 
there has been a tradeoff between efficiency and accuracy, with auto- 
mation providing the efficiency at the expense of flexibility, and 
analysts providing the adaptability needed for the required level of 
accuracy. Attempts at developing automated crop identification tech- 
niques which could approach the adaptability of a human analyst have 
rel ied on ground-based observations to train the technique to each par- 
ticular set of conditions. 

A thorough understanding of the crops themselves, as well as the 
processes involved in transforming radiation incident upon the crops 
into signals from the sensor is required for the development of a tech- 
nique which does not require ground based data for training. Previous 
work at ERIM, the University of California at Berkeley, and elsewhere 
has led to a sound understanding of these phenomena, and a crop identi- 
fication methodology employing the spectral developmental profiles of 
the crops of interest has evolved from that understanding [7,8,9,10]. 
These profiles describe the development of the crop over time in terms 
of Tasseled Cap Greenness, a feature derived from Landsat data space 
which is well correlated to the amount of green vegetation in the 
target [3]. 

The research reported here led to the development of an automatic 
corn and soybean labeling technique which attempts to adapt itself to 
scene-specific conditions. The procedure may be thought of as two 
interrelated parts: 1) selection of and identification of targets with 

"classic" profiles and 2) classification of remaining targets, which 
have "non-classic" profiles (see Figure 9). 


23 



A) 


B) 


C) 


D) 


E) 


Is target "classic"? 


Does profile fall outside 
allowed summer-crop grow- 
ing season range? 


Is target likely to be 
mixed"? 


Classify target using 
Nearest Neighbor 
Classifier 


Cluster all targets 



! 


I 

I 

\ 


I 


FIGURE 9. AUTOMATIC LABELING PROCEDURE FLOW 
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Selection of "Clas sic” Profi les. In analysis of the Greenness 
profiles of the crops of interest, particularly corn and soybean, it 
has been determined that there are several features which remain re- 
latively invariant across fairly large regions, in this case, the 
Central U.S. Corn Belt (Iowa, Illinois and Indiana). Some of these 
features are: 

1) Permanent vegetation and pasture is generally green throughout 
the growing season 

2) Non-vegetated areas are not green during the growing season 

3) Summer crop (corn and soybean) profiles generally have a single 
dominant vegetative phase 

4) Tree profiles generally reach peak Greenness before corn 

5) Corn profiles generally reach peak Greenness before soybean 

6) Soybean profiles generally reach a higher peak Greenness than 
corn. 

These features have been exploited to define a hierarchical de- 
cision logic which may be employed to capture and identify targets with 
"classic" profiles with high accuracy (see Figure 10). Since these are 
features which are relatively invariant across a large region, they can- 
not hope to capture all the variability present in such a region. The 
decision logic is chosen to be conservative in that, while it may have 
very high errors of omission (identifying typically 50% of the targets 
presented) the commission error rate on those targets is very low (<5%). 
The profiles identified as corn for a given scene are quite similar to 
each other, as are all the soybean profiles. Therefore, composite pro- 
files are generated for each of these crops by averaging the profiles 
of all the targets with a given crop label, as seen in Figure 11. 

The profiles identified as "non-summer" cover a much wider spectrum, 
ranging from never green (non-vegetated) to always green (permanent 
vegetation or pasture), and for this reason, no attempt is made to 
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derive a composite "non-summer" profile. Knowing that the duration of 
the summer crop growing season normally falls within a relatively small 
period, we can capture additional "non-summer" profiles which may have 
escaped detection by the hierarchical decision logic. To do this, the 
corn and soybean profiles are used to define a normal length for the 
summer crop growing season, and large deviations from this normal length 
are Indicators of the profile being non-summer. This process Identifies 
an additional 20-40% of the scene with a low (<5%) commission error 
rate. 

At this point, 50-90% of the total area has been Identified, with 
an accuracy of 90-95%. The remaining targets have "non-classic" pro- 
files, and are the type of targets which are normally Identified with 
the least accuracy by automatic procedures. 

Classification of "Non-Classic" Profiles . These "non-classic" tar- 
gets are typically composed of mixed signatures, or profiles of crops 
under varying types and amounts of stress. Previous work [11] showed 
that the overall shape of a corn or soybean profile may not change as 
much as the magnitude of the Greenness at any point on the profile. 
Therefore, classifying these profiles based on their overall shape was a 
logical approach to the problem of Identifying the "non-classics'. A 
Nearest Neighbor Classifier with Supremum Norm was selected as a tech- 
nique which would best perform this shape matching, with the com.posite 
profiles derived from the "classic" targets being used as the reference 
or training set for the classifier. The use of these scene-specific 
composite profiles as the training set allows the classifier to operate 
with a training set which Is adapted to the locally-specific conditions. 

Targets with a high probability of being "mixed" (more than one 
crop) are held In reserve, with the remaining targets being classified 
with this classifier. Those targets which best fit the corn reference 
profile are labeled "corn", those which best fit the soybean profile 
are labeled "soybean", and those which poorly fit both the corn and 
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soybean reference profiles are labeled “non-summer" (see Figure 12). 

The classification process Identifies an additional 10-50% of the scene, 
but with an accuracy of approximately 75%, somewhat lower than that 
achieved by the “classic" labeler - as Is to be expected from the nature 
of the targets being IdentlTled. With 90-98% of the scene now Identi- 
fied, all that remain are the targets which have a higher probability 
of being mixed, and therefore are not expected to receive "pure" labels 
as have all targets up to this point. 

All targets, "classic", "non-classic" and "probable mixed", are 
grouped using a spectral /temporal clustering algorithm [9]. The crop 
proportions of these clusters are computed from the labeled targets In 
each cluster, effectively labeling all the deferred, "probable mixed" 
targets, and completing the crop Identification for the entire scene 
(see Figure 13). 

Evaluation of Automatic Labeling Technique . To evaluate the tech- 
nique described above, the labeler and classifier were Implemented In 
an end-to-end segment area estimation procedure named C/S-IB. This 
procedure uses as labeling targets field-like structures called "blobs" 
which are defined by the BLOB algorithm, an algorithm which groups 
pixels which are spatially contiguous and spectrally similar over a set 
of acquisition dates [12]. The size of the scene processed was a 5 by 
6 nautical mile segment, 117 scan lines of 196 pixels each. BLOB typi- 
cally defined 700 to 1500 blobs for a segment, with approximately 70% 
of them (or 90% of the area) being "probable pure", the remaining 10% 
of the scene being "probable mixed",. Approximately 40 spectral /temporal 
clusters of blobs were formed In each segment. 

To perform the test, 53 segments of 1980 Iowa Landsat data were 
selected as being a data set Independent of the 1978 and 1979 Iowa, 
Illinois and Indiana data utilized In the development of the procedure. 
Of these 53 segments, 22 had the wall-to-wall ground data necessary for 
evaluation of the procedure. This ground data was used to establish 
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FIGURE 13. PROGRESSION OF LABELING 






the "true” crop proportions for each segment, against which all pro- 
portion estimates were compared. 

The acquisitions available for four of the 22 segments did not sup- 
port the separation of corn and soybeans, having no acquisitions during 
the period when summer crops reached peak Greenness. For those four 
segments, only summer/ non- summer Identification was made. Figure 14 
Illustrates the proportion estimation accuracy of the procedure C/S-1B 
on the 22 segments (18 for corn and soybeans). Table 4 defines the 
statistics displayed In that figure. 

The errors In estimating soybean proportions were consistently very 
low, being unbiased and with a variance uncharacteristically low for an 
automated labeling procedure. Although the variance In the corn and sum- 
mer proportion estimates was higher than that for soybean (see Figure 15), 
these variances were still low for an automated procedure, comparing 
favorably with results from analyst-oriented procedures using similar 
data sets. The low variance observed with this labeling procedure 
appears to be due to the ability of the procedure to adapt to segment- 
specific conditions through the use of a generalized, conservative de- 
cision logic to select the training set for the classifier. A significant 
bias In favor of corn was observed, and with the soybean estimates being 
very good, this corn bias also appeared as a significant over-estimation 
of the proportion of summer crops In the segment. Earlier studies have 
Indicated that the labeling targets formed by BLOB In the U.S. Corn Belt 
are not optimal, and In fact may contribute significantly to an over- 
estimate of corn [13] . 

Conclusions . An automatic corn and soybean labeling procedure based 
on solid understanding of the crop phenology and the physical effects 
present when utilizing space remote sensing for crop Inventory can pro- 
vide accurate Identification of crops without the requirement for ground 
observations. Familiarity with Greenness profiles for "normal" corn or 
soybean targets, and knowledge of how these profiles may vary from the 
"normal" profile for a crop led to the development of a procedure which 
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accurately identifies the ''normal" profiles for corn and for soybeans 
for each segment* and a classifier which can accurately associate the 
deviant profiles with those "normals". This resulted in a procedure 
which successfully adapts itself to local conditions without the aid of 
a human analyst. 

evaluation of the labeling procedure in area estimation procedure 
C/S-IB indicated high accuracy in identification of soybeans* with less 
accurate estimates of corn proportions. This result may not accurately 
reflect the achievable accuracy of the labeling procedure in identifying 
corn targets as the targets provided by C/S-IB were known to cause a 
bias in favor of corn. Investigation of alternative methods of handling 
^his mixed target problem will be the primary focus of this task for the 
remainder of the contract period. 
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4.0 

ADVANCED SATELLITE AND SENSOR SYSTEM DEFINITION 



Landsat MSS has been successfully applied to crop Inventory appli- 
cations as Is evidenced by the LACIE wheat survey and by operational 
Incorporation of Landsat data In USDA crop assessment surveys. However* 
both the spatial and spectral resolution of Landsat, and Its dependence 
on an external source of Illumination, limit the range and depth of 
application of this sensor. The goal of this task Is to examine and 
exploit alternate sensor designs to determine additional Information 
potential that can be derived from remote sensing. 

SEASAT $AR with Landsat MSS . The Initial objective of this Inves- 
tigation was to Identify and Illustrate the technical gains available 
to large area agricultural Inventories through the augmentation of 
Landsat data by Synthetic Aperture Radar (SAR) data. Analyses were 
applied to both Landsat MSS and SEASAT SAR data collected during the 
1978 growing season over an AgRISTARS test segment (844) in Jasper 
County, Indiana. 

The SEASAT satellite was launched on 28 June 1978 and ceased 
operation prematurely on 10 October 1978 due to a power system failure. 
Illustrated In Figure 16, Seasat was the first earth satellite dedi- 
cated to a general study of the oceans with microwave sensors. Though 
Intended for ocean Imaging, the SAR wa . activated over land areas as 
well. This afforded the opportunity to analyze the potential of an 
active microwave scanning device for agricultural land use monitoring. 
Microwave returns are dependent on two key terrain features that could 
be unique with respect to ground cover - surface roughness and dielectric 
constant - to which Landsat MSS does not respond. In addition, using 
ERIM's hybrid Image processing facility, SAR data from 25 July 1978 
were converted to digital data at 25 m resolution offering the oppor- 
tunity to examine benefits of finer spatial resolution. 
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FIGURE 16. SATELLITE CONFIGURATIONS 




Tone and Texture Processing . Figure 17 Illustrates the extracted 
SEASAT SAR segment image registered to Landsat MSS segment 844. To 
minimize the coherent speckle, a non-linear isotropic filtering 
algorithm was employed using ERIH's Cytocomputeryj^, a cellular automata 
based image processing capability. This algorithm avoids degrading 
edges, a problem that afflicts usual averaging procedures employed to 
remove speckle. Isotropic filtering consists of a sequence of 3x3 
neighborhood dilations and erosions and requires no a priori knowledge 
of field boundaries. The result of this process is shown in Figure 1&. 
The filtered image is then subtracted from the raw image and the re> 
sultant image, shown in Figure 19, called the texture image, rep/esc.it 
the extracted coherent speckle. 

Close examination of the texture image reveals noise patterns that 
can be associated with fields. Two texture measures were derived from 
this image. Contrast measures the amount of local variation in a sub- 
region and is defined as: 

"g "g 2 

con(d,0) = L E (i-j) P(i,j) 
i=l j=l 


where 

d,0 is the distance and angular displacement of a specific 
neighbor of pixel P(i,j) 

Ng is the number of grey levels. 

Entropy is a measure of local disorder and is large when a region is 
homogeneous. Entropy is defined as: 

Nq Ng 

ENT(d,0) = E E P(i ,j)logP(i ,j) 
i=l j=l 
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FIGURE 18. LOCAL TONE IMAGE 



FIGURE 19. LOCAL TEXTURE IMAGE 
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As everyone knows, crops are generally planted In bare soil, emerge, 
develop, and grow to a maxlmim ground cover while producing seeds and 
fruits and are finally harvested. At each development stage, every 
plant type manifests its own particular textural pattern. In addition, 
most domestic crops are planted in rows. From ground level, row effects 
are obvious to human observers even when the row spacings are as small 
as 10-20 cm which is typical for wheat fields. Row effects are even 
more pronounced in crops like corn, soybean, or sorghum. These crops 
are usually planted in rows which are 60-90 cm apart. 

Although the spatial resolution of SEASAT is substantially larger 
than these row spacings, certain, within-field textural variations are 
evident in the image. Potential sources of these variations are non- 
uniformities in the underlying soil characteristics, nutritional and 
moisture supplies, planting techniques, height and development stages 
across the fields. In relating the computed texture measurement values 
to specific crop types, the texture feature information was not regarded 
as a replacement but rather as an addition to the other features such 
as spectral, temporal and spatial information. In this case, it was 
found that low texture areas are mostly soybean fields, pasture areas 
and harvested wheat and sorghum fields while the high texture areas are 
from fields containing corn and other plants with considerable vertical 
development like trees and bushes. The combined use of an early Land- 
sat acquisition to distinguish native vegetation from tilled vegetation 
along with, the SEASAT SAR texture image enabled the separation of corn 
from soybeans approximately six weeks prior to spectral discrimination 
based on Landsat alone. In addition, due in part to Improved ground 
resolution of SEASAT, field outlines for agricultural fields were im- 
proved over the use of the Landsat MSS alone. 

Conclusions . This effort represents our first attempt at augmenting 
Landsat MSS data with SEASAT SAR imagery for digital crop classification. 
The results obtained provide a clear indication that, in spite of 
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coherent speckle, the SEASAT SAR data, with Its high resolution, 
affords a more accurate representation of agricultural field boundaries 
when appropriate non-linear filtering techniques are employed. 

SEASAT SAR data also provides additional spectral Information In 
the sense that the backscattered signals tell us much about the surface 
roughness of different crop fields. The corn/soybean separability In- 
formation contained In the SEASAT data from an acquisition date of July 
25 corresponds closely to the Information derived from Lai.dsat data 
obtained on September 8. Thus, Information from SEASAT could allow for 
an earlier estimate of the corn and soybean areas that can be achieved 
with Landsat alone. 

The specific features of "tone" and "texture" derived from the 
SEASAT data produced somewhat different crop cover maps. However, the 
limited amount of data analyzed do not support a specific conclusion 
concerning the relative utility of these two features. The single 
acquisition of SEASAT data available did not seem to support crop 
Identiflabll Ity beyond the separation of corn and soybeans. While It 
Is possible that this represents a basic limitation on microwave agri- 
cultural remote sensing, drawing such a conclusion Is certainly pre- 
mature given the absence of mul titemporal analyses which have been 
demonstrated to be so Important In Landsat Information extraction. 

Finally, the analyses conducted provided some basis for anticipat- 
ing that the joint use of Landsat and SEASAT could provide higher pro- 
portion estimation and mapping accuracy than could be achieved by 
either sensor alone. 
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5.0 

SUMMARY 



ERIM's support to the Inventory Technology Development Project of 
AgRISTARS Is structured into three tasks: 

1) Corn and Soybean Crop Spectral /Temporal Signature 
Characterization 

2) Efficient Area Estimation Techniques Development 

3) Advanced Satellite and Sensor System Definition 

Pursuit of the objectives of these tasks during the first six-month 
reporting period has resulted in a successful period of progress. 

A detailed statistical analysis of corn and soybean field measure- 
ment data base has provided important insight into those crops' signatures. 
Whereas a vegetative feature of soybeans was found to respond in a 
double-sigmoid manner, the corresponding corn spectral /temporal profile 
was found to 'plateau'. The use of this feature along with a maximum 
'greenness' feature was found to completely separate the two crops. In 
addition variations from normal crop profiles as a function of environ- 
mental or cultural effects (e.g., moisture stress) were determined and 
crop growth stages were correlated to the spectral features. 

Using standardized corn and soybean profiles, 'classic' features 
were determined and employed in an automatic area estimation technique. 
Results of an independent test on 198D Iowa Landsat data indicated pro- 
mising performance. Variance of the estimates were found to be very 
low, an unexpected result for an automatic technique, attributed in 
part to the procedure's attempt to adapt the 'classic' signature to scene 
specific characteristics. Though soybean estimates were unbiased, corn 
estimates revealed a significant bias that was due, at least in part, 
to the type of labeling target employed. Research in the remainder of 
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the contract period will emphasize the examination of this problem which 
Is closely related to the mixed pixel problem. 

Finally, SEASAT SAR data were used to augment Landsat MSS for crop 
Inventory. This study found that SEASAT SAR data, with Its high re- 
solution, affords a more accurate representation of agricultural field 
boundaries that could be exploited using automatic edge detection 
algorithms. SEASAT SAR also provides additional spectral Information 
In the sense that the back scattered signals relate to the surface 
roughness, I.e., canopy structure, of different crops. Two features 
called tone and texture, were extracted using a spatial data filtering 
approach based In cellular automata methods. It was found that, given 
comparable planting dates, corn and soybeans could be discriminated 
on the basis of surface texture differences earlier using SAR data In 
conjunction with Landsat than was possible using Landsat alone. 
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